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(54) Document authentication system 

(57) I n a system for authenticating documents (1 2) , 
such as banknotes, cheques or the like, a document (1*2) 
to be tested is driven past a sensing station (20) which 
provides a digital colour image of the document which 
is stored in a memory (38), in the form of plurality of dig- 
ital images obtained by illuminating the document (12) 
with light of different colours. The stored colour image 
is processed using template matching : for example; to 
determine the type and orientation of the document (1 2). 
The type and orientation' information is utilized to select 
a plurality of areas of the digital colour image for colour 
intensity analysis. For example, a statistical testing pro- 
cedure using stored values derived from processing . 
genuine documents may be utilised. Documents of dif- 
ferent types are thus all processed in a uniform manner 
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D scription 

This invention relates to a method and apparatus 
for authenticating documents. ' 

Automatic machines which accept banknotes and : s 
other documents such as cheques or giro documents 
are coming into increasing use. It is important for such *- • 
machines to authenticate the documents, that is/ to dis- ' 
tinguish between genuine and counterfeit documents. 

European Patent Application No. EP-A-O 101 115 - io 
discloses a device for recognising and examining ban- 
knotes or the like. In this known device, a monochrome 
(grey level) digital image of the transmittance of the ban- ■ 
knote is formed by directing light onto the banknote, as 
it is being fed through the device, and sensing the trans- is 
mitted light by using a row of photosensitive cells. Colour 
information may be derived by a separate photosensi- 
tive device or devices responsive to light of a particular - 
colour or colours. The colour information may be ihte- : ' 1 
grated overithe whole-note. Depending on the country 7 20 
whose banknotes the device is adapted to accept' the :i 
denomination of an inserted banknote may be deter il ; 
mined. For example, for Netherlands banknotes, the 
colour is characteristic of the denomination. For German' 
banknotes the length or length/width ratio are charac- '25 
teristic of the denomination. Items which are not recog- 
nised can be rejected immediately. Using the deter- 
mined denomination, a pattern recognition procedure 
takes place during which selected areas of the digital 
image are compared withdata stored 'in memories to 30 
determine the authenticity of the banknote! *lf the device 
is adapted to accept items which are of uniform size and 
colour such as US banknotes, for example, the denom- 
ination of the banknote has to be determined solely by ' A 
the pattern examination; Thus, the known device-has 35 
the disadvantage that reconfiguration to operate in a dif- ' 
ferent manner may be needed for some types of docu- 1 
ment to be authenticated. 

It is an object of the present invention to provide a v 
system for authenticating documents which is adapted *o 
to operate in a uniform matter, independent of the type 
of document to be authenticated. - 

Therefore/according to the present invention, there 
is provided a method of authenticating a document 
which may be of one of a plurality of types, characterized ! 45 
by the steps of: forming a digital colour image of said 
document; processing said digital colour image to iden- 
tify the type to which said document belongs and the ; 
orientation of the document; and analysing said digital * ' 
colour image in dependence on the identified document so ' 
type to determine the authenticity of the'document. ' 

One embodiment of the present invention wilt now 
be described by way of example, with reference to the 
accompanying drawings, in which:- 

55 

Fig.1 is a simplified block diagram of apparatus ac- 
cording to the invention, for accepting and authen- 
ticating documents; 



Fig. 2 is a enlarged view of an LED array utilized in 
the apparatus of Fig 1; 

Fig.j3 is a diagram illustrating the storage of digital 
! .colour' information derived from a document; ; ' 
Fig. 4' is a flowchart illustrating the general operation 
of the apparatus of Fig. -1 ; 

Fig.5 is a flowchart illustrating the recognition pro- 
cedure for recognising a document; 
Fig. 6 is a flowchart illustrating the authentication 
procedure for authenticating a document which has 
' : been recognised by the recognition procedure; and 
Fig:7 is a graphical plot helpful in understanding the 
authentication procedure. 

Referring first to Fig. 1 . there is shown a simplified 
block diagram of a document authentication system i 0. 
A document 12 is fed from an input slot (not shown) by 
document-transport means 14/ which may include con- 
ventional feed rollers and/or feed belts, along a feed 
path 16 in the direction of arrow 18. The document 12 
is fed past an image capture station 20 which includes 
' first and '"second LED (light emitting diode) arrays 22 and 
24. In the preferred embodiment, the docurnent 12 is 
driven in a vertical orientation and the LED arrays 22 
and 24 are each forrned by a vertical column of individ- 
ual spaced LED's. In a modified arrangement the docu- 
ment 12 could be driven in a horizontal orientation, with 
the LED : arrays being horizontally aligned. The LED ar- 
ray 22 includes a column of individual LED's, and the 
LED array 24 includes a column of individual LED's 23: 
The LED's of each array 22, 24 may be integrated on 
respective semiconductor substrates, enabling 1 a very 
close spacing of the individual LED's. 

Referring briefly to Fig. 2; there is shown a view of 
the LED array 22, which contains a column of LED's 26 
referred individually as 26-1, 26-2, 26-3 etc.'The LED's 
26 each emit light at one of three different wavelengths, 
corresponding to green light, red light and infrared light. 
Thus the diodes 26-1, 26-4, etc: may emit green light; 
the diodes 26-2, 26-5 etc. may emit red light, and the 
diodes 26-3, 26 : 6 etc. may emit infrared light. However, 
other colours of LED's may be used, for example yellow ' 
or blue. Furthermore, ihe total number of colours may 
be different from three. For example, two or four colours 
may be used,- although fewer j colours reduces the " 
amount of available information- sensed from the docu- 1 
ment 10. The LED array 24 (Fig.1) is of identical con- 
struction to the LED array 22. 

The LED arrays 22 and 24'operate under the control 
of ah illumination control device 30, in a manner which 
will now be described, to direct light onto the'document 
12. Light is reflected from the document 12 along path 
32 and focusod by a lens system 34 on to a CCD 
(charge-coupled device) sensor device 36. In an alter- 
native arrangement, the sensor could include an array 
of photodiodes. The CCD sensor device 36 provides, by 
sampling at periodic intervals, digital signals represent- 
ing the reflected light of the respective colours, which 



3 



EP 0 718 808 A2 



4 



are stored in a colour image memory 38 as a colour im- 
age of the document 12. The colour image memory 38 
will be described in more detail hereinbelow. A timing 
control circuit 39 synchronises the operation of the doc- 
ument transport 14, the illumination control circuit 30 
and the colour image memory 38. . . 

The illumination control 30 is effective to. control the \ 
illumination of the LED's 26, 28 in the arrays : 22, 24, such : 
that the green LED's, the red LED's and the infrared : 
LED's are operated sequentially and repeatedly, where- , 
by the document 12 is illuminated sequentially and re- • 
peatedly by green light, red light and infrared light. This . 
successive illumination is effected at a high speed rela- . 
tive to the movement of the document 12 along the feed 
path 16, such .that successive green, red, and infrared 
images are captured of substantially: the same regions , 
of the document 12. In this connection, it should be un- . 
derstood that although the three images produced by 
the successive colour illuminations are slightly out of 
alignment, due to the movement of document 12, the 
resolution of the patterns on the document 12 being inn- 
aged is significantly greater than this, and the slight mis-. . 
alignment of the images can therefore be ignored, in , 
practice. . < , . . , 

Although in tho preferred embodiment a digital col- , ; 
our image of only one side of the document 1 2 informed, - 
it should be understood that, in a modified arrangement, . 
the sensing station 20 could sense Jight reflected .from 
both sides of the document 12,. whereby, digital colour 
images of both- sides of the document. could be gener- 
ated and utilized in the subsequent recognition and au- . 
thentication procedures.^ In another modified arrange- ■. 
ment, instead of using light emitting diodes of.different 
colours, a white light source could be utilized and a col- . 
our CCD imaging system using colour filters could be 
included in the CCD sensor. 

The remaining portion of Fig. i will now be briefly 
described. The colour image data stored in the colour 
image memory 38 is first processed in a recognition and 
orientation processor.40, using reference data stored in 
a reference data mernory 42, to determine the prienta- . 
tion of the document 12 and to recognize the type of -the 
document 12. For example, if the document 1 2 is a ban- , 
knote, the processor 40 will determine in addition to the .. 
orientation of the banknote, the country, or issuing bank, „ 
and the denomination of the banknote. If the document- 
1 2 is not recognised as being of a type for which refer- 
ence data is stored in the memory. 42, a reject signal is 
produced oo an output line 44. The reject signal causes 
the rejected document to be returned to the input slot or , 
diverted to a reject container.(not shown). ■ 

Assuming that the document 1 2 is recognised, then 
a signal indicative of tho type and orientation of tho doc- 
ument is provided on an output line 46 to initiate a doc- 
ument authentication procedure, to be described here-, 
inbelow, in an authentication processor 43, which, like- 
the processor 40, uses data from the colour image mem- . 
ory 38 and reference data supplied from the reference- 
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data memory 42, to determine the authenticity of the 
document 1 2. Optionally, one or more subsidiary tests 
on the document 12 may be performed by the testing 

. device £>0. For example, the presence of magnetic ink, 
or a metallic strip may be tested. A signal representing 
the outcome of the subsidiary tests is applied by the test- 
ing device 50 over a line 52 to be utilized by the authen- 
tication processor 48 in. determining the authenticity of 
the document 12. The authentication. processor 48 pro- 
vides an output signal on a line 54 representing the au- 
thenticity or non-authenticity of the document J2. Thus, 
if the document 1 2 is determined as authentic, the signal 
on the line 54 may enable further operations such as 
initiating further processing of the document 1 2, or, if the 
document is a banknote, effecting a financial transaction 
in accordance with the determined value of;the ban? . 
knote. ...... , i ■« 

Referring now to Fig. 3, there is shown a represen- 
tation helpful, in understanding. the manner in which the 
digital colour image data is stored in the ccHour image 

; memory: 38. The colour image data is arranged, notion- 
ally, in three ."planes" 62, 64 and 66, wherein theplane. 

■» 62 stores green colourdata, the plane 64 stores red col- 
our data and the plane 66 stores infrared colour data. 
The data for a single pixel area in the document 12 is 

. represented along a line 68. linking shaded areas 72 in* 
f( the green colour plane 62, shaded area 74 in the red . 

. colour plane 64, and shaded area 76 in the infrared col- 
our plane 66- A similar representation to that shown in . 
Fig. 3 will apply if the image capture station 20 utilises 
other colours than green, red and infrared, and/or a dif- 
ferent number of colours, t- 

Referring to Fig. 4, the general operation of the sys- 
tem 1 0 is illustrated in the form of a flowchart 80. Initially, 
as shown at block 62, a digital colour image of the doc- 
ument 1.2 is lifted in the manner described hereinabove, 
that is, the digital colour image is formed and stored in . 
the colour image memory 38 (Fig. 1). 

Next, as shown at block 84, the type and orientation 
■of the document^are determined Jn the recognition and<- 
orientation processor 40 (Rig.1). If the document type is, 
recognised, the flowchart proceeds to block 86, where 
the document is tested for authenticity. The result of the 
authenticity test is the output resu It (block 90). If, at block 
86, the document type is not recognised: the flowchart 
proceeds directly to the output result block -90, as de-. 

. scribed hereinabove, wherein the authentication proc 7 . 
essor 48 (Fig. 1) produces an output signal on the line 
54 in accordance with the determined authenticity or 
non-authenticity of the document 12 which has been • 
recognised. Thus al! recognition and authentication in- 

, formation js presented on the Jines 44 and 54. 

Reletting now to Fig. 5, tho manner in which tho 
document type and. orientation are determined, in ac- 

• cordance with block 84 (Fig.4), will now be described in • 
more detail, with reference to the flowchart 1 00 shown 

. in Fig.5. Initially, thQ colour imagje of the document is 
stored in the colour image, memory 38 (block 82). Next, . 
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a size measurement of the document is effected (block 
102). For example, the length and/or width of the docu- ; 
ment may be determined by. scanning one of the three 
colour images stored in the colour planes 62, 64, and »: 
66 (Fig. 3).. Alternatively, the length could be determined.. 5 
by a photosensor (not. shown) located in the document • 
feed path 16. On the basis of the determined document 
size, templates are selected in accordance with the de- 
termined size (block 1 04) and a template matching pro- , 
cedure, to be described hereinbelow, is performed 10 
(block 106), The template matching procedure results: 
in the identification of the document 12 as being ot:a 
particular type and also determines its orientation. If no 
match is found, the document 12 is not recognised and 
may be rejected, as mentioned hereinabove. It should ?5 
be understood that the size determining step (block 1 02) 
is optional, and may be omitted, although. this may inr. . 
crease -the processing time involved ;in the template:. 
matching procedure, since a larger number of templates ■ = : > 
may need to be utilized* in the matching procedure, 20 

The template matching procedure utilized in the 
preferred embodiment averages small square regions 
of the document image, typically regions of size 16' by:" 
16 pixels, thereby reducing the amount of data to be : 
matched and so speeding up the template matching pro- 2S 
cedure. Also, the. template matching procedure is per- . « 
formed on a colour combination image, referred to here-. . 
in as a grey image. For example the grey image may be 
formed by combining the green and red colour images, 
stored in the respective planes 62 and 64 (Fig.3). How^ 30 
ever, other combinations are possible, e.g. the green >' 
and infrared images, as all three images could be com-:! 
bined, to form the grey image. The grey , image may be v 
stored in a memory portion of the processor 40. f n ;> 

The grey-image is averaged by calculating the av- . 35 
erage pixel intensity value of regions of size 16 by 16 . - 
pixels, that is, 256 pixel size square regions. This cor*.:** . 
responds to regions of size about 4mm by 4mm. How- 
ever, regions of other sizes could be used. With a 16 by i 
16 pixel size region, a typical document image contain- *o 
ing around 1 00,000 to 200,000 pixels is reduced to an 
image of less than 1 ,000 elements by the averaging pro- 
cedure.. As mentioned, this averaged image may be- 
stored in a further memory portion of the processor 40, 
and utilized for matching with templates derived from the 45 
reference data memory 42(Fig.l )..The template match- 
ing procedure determines the template having the clos- 
est match to the averaged image, utilising a predeter- 
mined threshold value for rejecting unrecognisable irtR 
ages. (twill be appreciated that the closest match tern- , so 
plate provides information as to the type and orientation 
of the document 12. The templates stored in the refer- 
ence data memory 42 generated in a preliminary train- 
ing procedure during which genuine documents of the 
types to be recognised are scanned in all four possible 55 
orientations. 

Referring now to Fig. 6, the authentication proce- 
dur will now be described with reference to the flow- 



chart 120.*shownHn Fig. 6. From the start block 122 the 
flowchart proceeds to block 124 where it is noted that 
. the authentication regions for. the determined document 
type and .orientation are selected. Typically between 
eight and thirty-two regions are:used, with a typical size 
of between 2.5mm and 7.5mm square, although the re- 
gion size could be greaterthan these values. Preferably, 
the regions are evenly spaced over document. Howev r 
er, regions which are not evenly space may be selected 
as appropriate for certain types of document. Since the 
image of the .document is held in the colour image mem- 
ory 38, regions may be selected dependent on the doc- 
ument type and orientation; under, software control, 
without any hardware modifications for different docu- 
ment types. 

Next, as shown at block 126, feature vectors are 
•calculated for the selected regions. This is effected as 
follows. The pixel intensity values^ for the selected re- 
gions are averaged for each colour plane 62, 64, 66 (Fig. 
3) to provide average colour intensities for the selected 
regions. For each selected region a feature vector z=(x, 
jy) is calculated where x is the ratio of green to red av- 
erage intensity for the region and y is the ratio of infrared 
to red average intensity for the selected region. It will be 
appreciated that by- utilising intensity ratios, instead of 
absolute values, in calculating the feature vectors - the 
components from different samples are effectively nor- 
malised. Of course, instead of the ratios of green and 
.infrared to red, other ratios such as red and infrared to 
green could be chosen. • 

Next, as shown atblock 128, authentication param- 
eters for the selected regions are retrieved from the ref-' 
erence data memory 42 (Fig;1), following which an au- 
thentication process for each selected region is per- 
formed (block 130). The . retrieved reference data for 
each region is formed by a set of values, namely a mean 
vector and the elements of a 2x2 covariance matrix. The 
mean vector and elements of the covariance matrix are 
calculated from 1he feature vectors of sample, genuine 
documents during an initial training phase which pro- 
duces the reference data. Returning to the description, 
of block 130, the. Mahalanobis distance of the feature 
vector from the mean is then calculated using the re- 
trieved reference data. The concept of Mahalanobis dis- 
tance is well known to those skilled in the pattern rec- 
ognition art. For example, see page 24 of the text book 
"Pattern Recognition and Scene Analysis" by R.O. Duda 
and P. E:. Hart, published in 1 973 by John Wiley & Sons. 
As is known frorn statistical theory, the contours of con- 
stant Mahalanobis distance from .the mean are in the 
form of ellipses, centred on the mean lvalue. For a 
threshold value of T, points having a Mahalanobis dis- 
tance less than T lie. within an ellipse, centred on the 
mean value and points having a Mahalanobis distance 
greater than T lie outside the ellipse. 

Referring to Fig.7. the mean feature vector (M x ,M y ), 
shown as point 150, is the centre of an ellipse 160 which 
corresponds to threshold value T. The ellipse 160 has a 
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major axis 162 and a minor axis 164. If the calculated 
feature vector lies within the interior 166 of the ellipse 
160, i.e. the Mahalanobis distance is less than T, then 
the corresponding region of the document 12 being au- 
thenticated is categorised as authentic. If the calculated 
feature vector lies outside the ellipse* 160, i.e. the Ma- 
halanobis distance is greater than TMhen the correv 
sponding; region of the document s is categorised as 
non-authentic. If, in a modification,, the feature vector ; 
has three or more components, then the ellipse would 
be replaced by an ellipsoid in multidimensional space. ' 

Returning now to Fig. 6, there is shown an optional 
step of performing subsidiary tests on the document 1 2. 
As mentioned previously, the subsidiary testing device 
50 (Fig 1 ) may perform tests such as a test for the pres- 
cnce ol a metallic strip and/or the presence of magnetic 

As shown in block 134 an authentication* decision 
i .„* n o cjocument 12 is now made, wherein the docu- 
r»ioo! i ; categorised as authentic only if all, or at least 
r » ; i v u»d number, of the selected regions tested for 
.* v -.1 u «• » ,vj described hereinabove have been found 
i _ t * - and the results of any optional subsidi- 
!.->•■ iiso been found to be authentic. The flow- 
K-f ••• i t-wv» ends (block 136) and the document 12 . 
v. » t titth/cd for a transaction operation, if 'au%.:. 
t'....r»!^ :.« ro « ; c ted, if non -authentic. «» • *• . : 

i ^v:^j a •*? understood that modifications of the de- : 
&~ t it. xj o"^>:-jirnent are possible. For example, instead 
?r« <;f ^tiMai-,ii technique for determining document aur 
ff»on!« tr/ \rc basis of Mahalanobis distance calcula-.; 
lions «i neural network could be used to analyse the fea- 
ture vectors. The neutral network would be trained by > 
uWis*k1 aenume documents and would then be effective 
to authenticate a document by determining the authen- 
ticity ol a plurality of document image regions. Also; the 
recognition and orientation procedure may_use a pattern * 
recognition procedure other than template matching. 

Thus there has been described a system for au^ 
thcnticating documents which is suitable for authenticat- 
ing various types of documents including banknotes, ; 
cheques and giros, for example, in a uniform manner. 
The two-stage procedure of first determining document 
typo and orientation and then determining authenticity 
enables an efficient document processing* system hav- 
ing high security to be provided. Thus, unrecognised «. 
documents can ,be rejected immediately, without the. 
need fonauthentication. Forming a digital colour image 
assists in providing a two-stage authentication procer 
duie wi nch is highly efficient since use of colour intensity 
values provides enhanced analysis capabilities and . 
greater accuracy in determining authenticity as com- ; 
pared with monochrome analysis; Moreover, since dig-; 
ital colour information is derived from the whole docu- 
ment, the performance of the recognition and orientation 
procedure is not degraded by localised marks or dam- ' 
age. Also the authentication can be focused on selected 
regions by software control. Thus, the system can be 
easily reconfigured by software modification to handle 
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Claims" 

1. A method of authenticating a document (12) which 
may be of one of a plurality of types, characterized 

■i by the steps of: forming a digital colour image ol said 
document (12); processing said digital colour image 
-to identify the type to which said document (12) be- 
longs and the orientation of the document; and an- 
alysing said digital colour image in dependence on 
the identified document type to determine the au- 
thenticity of the document (12). 

. • ■•-■»'•.,. 

2. A method according to claim 1 , characterized in that 
said.step.of forming a digital colour image includes 
the step of forming a plurality of digital images each 4 
representing the reflected light intensity from said' 
document (12) for a respective colour. ■ 
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A method according to claim 2, characterized in that 
said step of processing said digital colour image in- 
cludes theatep of identifying the document type by 
using a template matching procedure. 

A method according to claim 3, characterized in that ; 
said, processing step includes the steps of forming^ 
a grey level digital image by combining at least two -z- 
of said digital images; averaging a plurality of areas ~ 
of said grey level digital image; and utilising the av- ; 
eraged areas in said template matching procedure. 

A method according to any one of the preceding '» 
claims, characterized in that said analysing step in- 
cludes: selecting a plurality of regions of said digital 
colour image of said document (12); calculating a ,; 
feature vector dependant on colour intensities for 5 / 
each of said regions; determining a distance meas- T 
urement dependent on the difference between said 
feature vector and reference data derived from gen- 
uine documents; 4 and determining/ said document 
(12) to be authentic if said distance measurement 
is less than a predetermined, threshold value. 

A method according to claim 5, characterized in that ■ 
said calculating step includes the step of forming 
ratio. values of average colour- intensities for each 
of said plurality of regions. »;■■.'. 

A method according to claim 6, characterized in that 
said step of forming. ratio values includes selecting 
from said digital colour image the colour intensity 
value of a predetermined colour and dividing the 
other colour intensity values from said digital colour 
image by the selected intensity value. 



" 8. A method according to claim 7, characterized in that 
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said step of determining a distance measurement 
includes determining the Mahalanobis distance be- 
tween said feature vector and a mean value vector 
representing a mean value for genuine documents, ~ j 
included in said reference data. . 5 

9. A method according to any one of claims 5 to 8, 
characterized by the steps of performing at least . j 
one additional authenticity test and determining 

said document (12) as authentic only if said addi- io \ 
tional authenticity test is also satisfied. 

10. Apparatus for carrying out a method according to > 
any one of the preceding claims, characterized by 
sensing means (20. 36) adapted to provide a digital 15 
colour image of a document (12) being authenticat- 
ed, storage means (38) adapted to store said digital 
colour image, first processing means (40) adapted 

to determine the type of said document, independ- , 
ence on the stored digital colour image,; and : 20 
processing means (48); adapted to determine the 
authenticity of said document (12) in dependence 
on the determined document type and said. stored 
digital colour image. • « ". ' 

y '■. *' 25 

11. Apparatus according to claim 10, characterized by 
illuminating means (22,24) adapted to illuminate i" *"" 
said document (12) successively with light of a plu- j 
rality of different colours. 

, 30 

12. Apparatus according to claim 11, characterized in 
that light of three different colours is utilized. 

13. Apparatus according to claim 11 or claim 12, char- 
acterized in that said illuminating means includes 3S 
light emitting diodes (22,24). i. > ! - 

' r i '■■ ; 
* < f \ 40 I . 
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(54) Document authentication system 



(57) In a system for authenticating documents (1 2). 
such as banknotes, cheques or the like, a document ( 1 2) 
to be tested is driven past a sensing station (20) which 
provides a digital colour image of the document which 
is stored in a memory (38), in the form of plurality of dig- 
ital images obtained by illuminating the document (12) 
' with light of different colours. The stored colour image 
is processed using template matching, for example, to 
determine the type and orientation of the document (1 2). 
The type and orientation information is utilized to select 
a plurality of areas of the digital colour image for colour 
intensity analysis. For example, a statistical testing pro- 
cedure using stored values derived from processing 
genuine documents may be utilised. Documents of dif- 
ferent types are thus all processed in a uniform manner. 
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